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^  I  gonsider^a  \inear  model  Y  «xfr  +  oe,  E(e)  »0,  E(te)»I^  with 
£,<$  unknown.  For\the  problem  of  testing  the  linear  hypothesis 

imCC7 )  j^ira(x' ) ,  Ghosh  and  Sinha  (1980)  proved  that  the  pro¬ 
perties  of  the  usual  F-test  being  LRT  and  UMPI  (under  a  suitable 
group  of  transformations)  remain  valid  for  specific  non-normal  5 

families.  In  this  paper  it  is  shown  that  both  criterion  and  in- J 
ference  robustness  of  the  F-test  hold  under  the  assumption  p  ^q(e-^e) 

q  convex  and  isotonic.  This  result  is  similar  to  a  robustness 

T  s*fr*+s*JL* 

property  of  Hotelling's  JPt-test  proved  by  Kariya  (1981).  Finally 

it  is  proved  that  the_JBest  Linear  Unbiased  Estimator  (BLUE)  of  any 

plU,  ,sX^. 

estimable  function  Cff  is  more  concentrated  around  C ft  than  any  other 
unbiased  estimator  of  C p  under  the  assumption  that  ^  is  spherically 
distributed.  — - _ 
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1 .  INTRODUCTION 


Ve  consider  the  linear  model 


Y«X6+oe,  (1.1) 

where  Y  is  n*i,  x  is  nxk,  $  is  k  xl  and  a  >  0.  It  is  assumed 
that  Rank  (X)  -  r  <  k  <  n  and  that 


Then 


Ee*0,  Cov  e»E(ee')«I  . 


(1.2) 


EY-X8,  Cov  Y  -  o2In.  (1.3) 

Ve  denote  by  im(B)  the  column-space  of  a  matrix  B. 

Ve  want  to  consider  linear  hypotheses  of  the  kind  HQ:  C8  ■  6 
where  C  is  a  s  x  k-matrix,  Rank  (C)*s.  In  order  that  these 
hypotheses  are  testable  it  is  necessary  that  im(C' )  c im(x' ) , 
i.e.,  C-TX  for  some  T.  It  is  well-known  that  the  standard  F -test 
is  both  LRT  (Likelihood- Ratio-Test)  and  UMPI  (uniformly  most  power¬ 
ful  invariant)  under  the  normality  of  the  vector  e  with  respect 
to  a  suitable  group  of  affine  transformations.  Ghosh  and  Sinha 
(1980)  proved  that  both  of  these  properties  of  the  F-test  remain 
valid  even  under  typical  non-normal  distributions  of  the  errors, 
namely  normal  (scale)  mixtures  which  include  multivariate  t- 
distributions.  The  purpose  of  this  paper  is  to  prove  an  even 
stronger  result.  It  is  shown  that  the  F-test  is  both  LRT  and 
UMPI  under  the  distributional  assumption 


2 


e  ~  q(c  £),  q  convex  (1.4) 

(i  describee  an  isotonic  function).  The  results  are  similar  to 

o 

a  robustness  property  proved  for  Hotelling's  T  -test  by  Kariya 
(1981). 

In  section  2  we  present  a  canonical  form  of  the  problem 
and  section  3  deals  with  the  UMPI  property  of  the  F-test.  To 
obtain  the  distribution  of  a  maximal  invariant,  certain  results 
due  to  Dawid  (1977),  (see  also  Dempster  (1969))  and  Vijsman's 
representation  theorem  (Vijsman,  1967)  are  used.  The  property  of 
the  F-test  being  LRT  and  the  distribution  of  the  F-statlstlcs  under 
(1.4)  are  indicated  in  section  4.  Finally,  in  section  5  it  is 
shown  for  a  more  general  linear  model  with  spherically  distributed 

error  that  the  BUIE  (Best  Linear  Unbiased  Estimator)  of  au  estimable 
function  CB  is  more  concentrated  around  CB  than  any  other  un¬ 
biased  estimator  (robustness  property  of  the  BLUE). 

2.  A  CANONICAL  FORM 

According  to  our  assumption  rank  (X)  -  r^k<n.  Then  there 
exists  (see,  e.g.,  Rao  (1973))  a  quasi-orthogonal  matrix  Pj  of 
order  k  xd  such  tha  PjP^  ■  Ifc,  and  k  * k-diagonal  matrix  A  and  an 
orthogonal  k  x  k-matrlx  Q  such  that  the  singular  value  decomposi¬ 
tion 


X-Pj  AQ 

2  2  2 

holds.  Here  A  •  diag(X1, . . . ,X*,  0,...,0) 
positive  eigenvalues  of  x'x.  Supplement  P^ 


(2.1) 


2 

and  the  XA  are  the 
by  P2,  a  matrix  of 


order  n-kxn  such  that  P  -  (P^  :  Pg)  is  an  orthogonal  nxn-matrix. 


Let  us  now  consider  the  transformation 


where 


Ta)  -piY  * PjXg  +  aP^e  •  Ay  + 
Y<2)  “  P2Y"0P2e"0el  ’ 


el  "  Pl€*  e2  "  P2e »  Y  »Q8  -  (Yx . Yk)’  . 


(2.2) 


(2.3) 


Note  that  Ay  * diag(X1Y1, . . . ,XrYr,  0,...,0).  We  denote  the  n-r 

components  of  the  vector  Y  ■  (Y^^Y^)'  ^ve  mean  zero 

by  ui» • • • 'un_r*  The  vector  °f  the  r  components  of  Y^» 

which  have  possibly  a  non-zero  mean,  is  denoted  by  ^ ^ .  Since 

C-TX,  the  equation  C8  *  6  is  equivalent  to  TXB«TPj  AQ8  «  TP^  Ay 

■  6.  Now  let  us  split  up  Px  as  Pj  *  (P^.P^) ,  where  PlX  is 

n  x  r  and  P12  is  n  *k-r.  Let  Tj  *T  P^.  Then  clearly  rank  (Tj)  »s 

and  TXB  -  6  is  equivalent  to  Tj^  diag(X1Y1, . . .  ,XrYr)  -  6.  Let 

T2  be  a  r-s  x  r-matrix  such  that  Rank  (T2)  ■  r-s  and  -  0. 

We  now  employ  the  following  transformation: 


*(11) 


r<vi>  1(TiY(n)"^“  (vi*  *  *  •  ,vs) 

^Y2T2^  ^Y2Y(11)^  "  ^wl' ’ ’ ’ ,wr-s^  * 


(2.4) 


Combining  (2.2)  and  (2.4)  we  can  conclude  the  following: 

v  -  (v1,...,v#)'  -  e+atj  (2.5) 

w  -  (Wj, . . .  ,wr_8)’  -  n  +  ce2 

U  ■  (U^,  ...  "  863  , 

with  e  *  (e^,e2,e3) '  »  Ee"°*  *IQ,  e  ~  q(e'e),  q  convex,  -I  and 

2 

H-:  A0  •  6  is  equivalent  to  Hrt:  0»O,  n  and  0  being  nuisance  para- 


•41 


.r*  ; 


meters.  This  is  the  canonical  form  of  the  problem.  It  may  be 
noted  that  Ghosh  and  Sinha  (1980)  made  use  of  this  canonical  form 
without  explicitly  stating  how  it  can  be  obtained.  The  above 
analysis  spells  out  clearly  the  necessary  steps  leading  from  (1.1) 
to  (2.3).  Under  the  assumption  of  normality  of  e  it  follows 
clearly  that  the  7-test  based  on  F-(v'v)/(u'u)  is  LRT  and  UMPI 
(under  a  suitable  group  of  transformations). 

3.  UMPI  -  PROPERTY  OF  THE  F-TEST 
Without  any  loss  of  generality  we  treat  the  problem  in  the 
canonical  form  (2.5).  As  in  Ghosh  and  Sinha  (1980)  obviously  the 
testing  problem  remains  invariant  under  the  group  G  of  trans¬ 
formations 

v  ♦  c  Pfiv,  w  ♦  w+b,  u  c  Pn_ru,  (3.1) 

• 

where  c  runs  over  the  non-zero  reals,  b  runs  over  !Rr"8, 
and  runs  over  pk,  the  group  of  k*k  orthogonal  transformations 
(k«s  and  n-r,  respectively).  As  is  well-known  a  maximal  invariant 
under  G  is  Tq  *  (v'v)/(u'u)  and  a  maximal  invariant  parameter  is 

f  O 

6  -  (0  9)/o  .  To  obtain  a  formal  expression  of  the  distribution 
function  of  Tq,  we  first  note  that  the  joint  distribution  of  v 
and  u  has  the  density  (Dawid  (1977),  Dempster  (1969)) 

f(v,u|0,o2)  -o-<n"r+8)  q(C(v-e),(v-6)+u,u]/o2),  qconvex,^.  (3.2) 

To  obtain  the  distribution  of  Tq  from  (3.2)  we  apply  Wijsman's 
(1967)  representation  theorem  which  we  state  below  as  a  lemma  in 
a  suitable  form: 


3.1  Lemma.  Let  f(z)  be  the  pdf  of  z*(v,u  )  and  let 
Tn  *  t(z)  be  a  maximal  invariant  under  the  group  G  of  transforma- 

u  T 

*0 

tions  (3.1):  v  ♦  c  P„v,  u  -►  c  P„  u.  Let,  moreover,  P.  be  the 

s  n— r  o 

»  2 

distribution  induced  by  Tn  under  6  ■  (6  6)/o  .  Then  the  pdf  of 

T  u 

T  with  respect  to  Pft°  evaluated  at  Tn  *  t(z)  is  given  by 


4—  ( t (z) )  -  fT  (t(z)|«) 


(.3.3 


-  (J  f(gz|0,o2)|c|n‘r'sdv(g))/(|  f(g.z|0,c2)|c|n"r"sdv(g)) 
where  v  is  a  left  Invariant  measure  on  G  and  g»(c,P  ,P  ), 

o  n*r 

gz-  (c  Psv,  c  Pn.ru). 

Conditions  under  which  (3.3)  is  valid  are  stated  in  Wijsman 
(1967).  It  is  easy  to  verify  that  these  conditions  are  satisfied 
in  our  case  [see  Kariya  (1978,  1981)].  We  choose  v  »  vj  x  v2  x  v3 
where  d  v^c)  ■  dc  /  j  c  |  and  and  Vg  are  the  left  invariant 
probability  measures  on  P  and  P„  respectively.  Lemma  3.1 
applied  to  our  setup  (3.2)  yields  tne  following. 

3.2  Lemma.  The  pdf  of  TQ,  fT  ( t | 6 )  is  evaluated  as 


(  |  f  q(c2-2cC(v,Psn)/(v,v+n,n)i]+n'n)dv2(Ps)|c| 

•00  r 

8  oo 

/(  {  q( c2 ) | c | n“r+8“1dc) , 


n-r+s-1 


(3.4 


where  n  ■  e/o  and  n  n  ■  6. 

Proof.  From  (3.2)  and  the  action  of  the  transformation  g  on 
z  ■  (v',u')'  we  get 


6 


>c'v’  •  .  * 

«.  .  '  v 


f(g*z|6,o2) *  o”^n-r+s^q(E(cPgv-6)(cPsv-0)  +c2u’u]/o2) 
■  o”^n”r+S^q(Cc2(v,v+u,u)-  2cv’Pg  0  +  e'e]/a2) 

*  0-<n“r+8>q((c*)2  -2c*(v’v+u'u)’iv,p:n  +  n  n) 

S 


where  c*  ■  [c(v'v  +  u'u)*3/o. 

From  (3.3)  the  numerator  of  fT  (t|5)  is  obtained  as 
•  0 

|  ||  q((c*)2  -  2  c*  v'PgnCv'v+u'u)”^  rt'n) 


-0°  P 


r-s  ?. 


* in-r+s-1 


(v,v+u'u)"(n"r+8)/2dc*dv«(Pt5)dv„(P 


2vs3vr-s 


(3.5) 

) 


whereas  the  denominator  of  (3.3)  obtained  from  (3.5)  by  putting 
n  ■  0 ,  is  given  by 

) 

Since  the  integrand  in  (3.5)  does  not  depend  on  P  and  the  integrand 

in  (3.6)  does  not  depend  on  P„  and  P„  _  and  the  integral  [  dv4(P  ) 

s  r-s  j  3  r-s 

r  r‘8 

equals  one,  together  with  I  dv2(Pg)  ■  1,  by  taking  the  ratio  of 

(3.5)  to  (3.6),  the  lemma  follows.  Q.E.D. 

We  are  now  in  a  position  to  prove  our  main  result. 

3.3  Theorem.  Under  the  model  (2.3),  the  F-test  based  on  TQ 

is  UMPI  with  respect  to  the  group  G  of  transformations  (3.1). 

Proof.  Using  the  convexity  of  q  we  will  show  that  fT  (t|6) 

T0 

for  fixed  5  > 0  is  isotonic  in  t  (ft),  thereby  proving  the  theorem. 

Let  t*  -  v(v'vHi’u)"*  implying  that  fT  (t|6)  evidently  de¬ 
pends  on  t*.  We  first  show  that  fTQ(t  |6)  |t<l  -  f  (t  1 6 )  |0(s)t*  for 


U.  ( 


q((c*)2)|c*|n"r+8_1(v,v+u’u)“(n"r+s)/2dc*dv2(Ps)dv3(P 


r-s  8 


r-o 
(3.S) 
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all  orthogonal  matrices  0(s)«  P  .  This  will  mean  that  f  really 

s 

depends  on  (t*)'t*,  l.e.,  on  t.  Replacing  t*  by  0(s)t*  we  get  the 

numerator  of  f_  (t|6)  in  (3.4)  as 
•  0 

I  |  q(c2-2c  v'(0(s))P8  n (v'v+u'u)"^+n,n) |c|n"r+s"1A»2(P8)dc. 
Ps 

Since  (0(s))'P8  is  orthogonal  and  v 2(PS)  *v 2( (0(s) ) 'P8)  due  to  the 

left-invariance  property  of  the  measure  v  the  claim  follows. 

Denoting  the  numerator  of  f_  (t|5)  by  H(t*|6),  then  in  view 
*  *  0 

of  H(t  | 6 )  ■  H(-  t  | 6)  it  follows  from  the  convexity  of  q  that 
for  any  a  c [0,1]: 

H(-t*|6) -H(t*|6) -a  H(t*|6)  +  (1-a)  H(-t*|5)  (3.7) 


•  |  |  Co  q(c2-2c(t*)'  P8  n+n'n) 

-  Ps 

+  (l-o)  q(c2+2c((t*)'P8  n+n,n)3!c|a”r+*’1dv2(Ps)dc 
00 

>  J  (  Cq(c2-2c(2a-l)(t*)'P8n+ n'n)]|c|n’r+8'1dv2(P8)dc 
~"Ps 

*  H((2a-l)t*|«)  -  H(-  (2«-l)t*|5). 

Since  H(t*|6)  depends  only  on  (t*)'t*  and  (2a-l)2  £  1  it  follows 

indeed  that  f-  (t|£)  is  isotonic.  Q.E.D. 

T0 

4.  LRT  -  PROPERTY  OF  THE  F-  ’’EST  AND  ;TS  DISTRIBUTION 
Since  q  it  follows  that  the  ~  ixituom  likelihood  estimators 

A  A 

of  9,n  are  given  by  6  »  v,n  ■  w,  yielding 


v.*  •  '  ' 


sup  L(e,n,02  |v,w,u)  -  c~nq(Cu,u]/02).  (4.1) 

e,n 

In  order  to  maximize  the  right  hand  side  of  (4.1)  with  respect 
to  a  it  is  easily  seen  that 

sup  o"n  q(Cu'u]/o2)  ■  (u'u)”n/2  K  (4.2) 

a 

— n  —2 

where  K  *  sup  o  q(o  ). 
a 

Similarly  the  supremum  of  the  likelihood  function  under 
Hq:  6*0  is  obtained  as 

sup  o_n  q(Cv' v+(w-n) '(w-n)]/c2)  *  (u'u+v'v)-11/2  K.  (4.3) 
n,o 

Hence  the  LRT  is  equivalent  to  the  F-test. 

That  the  F-statistic  F  *  (v' v)(n-r)/(u'u)s  is  distributed 
as  a  central  F-variable  under  Hq  whatever  q  may  be  follows  from 
the  results  due  to  Dawid  (1977). 

5.  A  ROBUSTNESS  PROPERTY  OF  THE  BEST  LINEAR  UNBIASED  ESTIMATOR 
Consider  the  linear  model 

y  -  XB +Uet  E(e) -0,  E(ee') -In.  (5.1) 

where  X  is  a  given  nxk  and  U  is  a  given  n  xm -matrix.  Rank  (U)  *m. 
Then 


Ey»XB,  Cov  y  ■  E(y-Ey )(y-Ey) '  *  UU'  »  :Q.  (5.2) 


Let  C6  be  any  estimable  function  of  6,  i.e.,  C  * TX  for  some  T. 

A  best  linear  unbiased  estimator  of  C6  is  any  ' inear  function  G 
such  that  GX  ■  C  and  GQa  -  0  if  X'a*0. 


In  the  sequel  we  will  assume  that  e  is  spherically  distri¬ 
buted.  This  means  that  Te  has  the  same  distribution  as  £  for 
all  orthogonal  mxm  matrices  T  .  If  £  has  a  density  this  is 
equivalent  to  the  requirement  that  the  density  is  a  function  of 

I  I 

£  £ .  This  follows  from  the  fact  that  £  £  is  a  maximal  invariant 
with  respect  to  the  group  of  orthogonal  transformations. 

We  will  show  that  any  BLUE  Gy  of  C$  is  more  concentrated 
around  C0  than  any  other  unbiased  estimator  Ly  of  C0.  More  pre¬ 
cisely  : 

5.1  Theorem.  Let  the  model  (5.1)  be  given  and  let  £  be 
spherically  distributed.  Then  for  any  ccR  and  any  n.n.d.  matrix 
A  of  appropriate  order 

P((Gy-C6) '  A(Gy-Ce)  <c2)  >  (5.3) 

( Ly-CB  )  ’  A(Ly-C3)  <  c2), 

where  Gy  is  any  BLUE  of  C6  and  Ly  is  any  unbiased  estimator  of 
C6. 

Proof .  For  any  unbiased  estimator  Ly  of  C0  we  get  Ly  * 

LX0+L  Ue-CB+L  Ue.  Therefore  the  two  probabilities  which  have 
to  be  compared  are: 

P((eVg'  AG  Ue)  <c2)  and  P((eVl'  AL  Ue)  <c2).  (5.4) 

We  prove  that  for  any  LQ  the  non-zero  eigenvalues  of  u'l^ALqU 

and  A*  L JJU'  l'  A*  -  A*  L,  Q  l’  A*  coincide.  Indeed  if  u'l,  A  LUx  « 

o  o  o  o  o  o 

Xx,  xj*0,  then  X  A*LQ  Ux  -  A*  LQ  UU'  LqA*A*L0  Ux  »  A*LQ  Q  L^A*(  A*LQ  Ux) 

i  '  i  4 

implying  that  X  is  an  eigenvalue  of  A3L  QL  A3  unless  A3L  Ux  -  0 


in  which  case  X«0  in  view  of  xj*0.  In  the  same  way  it  follows 
from  A*LqQL^  A^y  ■  yy  by  premultiplying  with  UL^A^  that  y  is  an 
eigenvalue  of  U* A  LQ  U  unless  U'L^  A®y  *  0  in  which  case  again 
y  »  0. 

Since  A^  GQ  G'  A^  A^  L  Q  L  A^  by  the  BLUE-property  it 
follows  from  the  Courant-Fisher  min-max- Theorem  (see,  e.g., 

Bellman  (1970),  p.  115-117)  that  all  the  eigenvalues  of  A^GQg'a^ 
are  smaller  than  the  corresponding  eigenvalues  of  A^LQL'A^  if 
ordered  according  to  decreasing  magnitude.  This  would  also  hold 
for  U'g'agu  and  u'l'ALU  if  we  can  show  that  the  dimension  of  the 
null-space  of  u'l'aU cannot  be  greater  than  the  dimension  of  the 

V  I  f 

null-space  of  U  G  AGO.  Now  U  GAUx  ■  0  is  equivalent  to  AGUx*0. 
This  can  happen  either  if  x*U'b,  X'b  *  0  or  Ux»XB  and  ACB  * 

ATX 8  ■  0.  If  Ux  -  XB  and  TX8  ■  CB*  im(A)  does  not  vanish  un¬ 
less  CB  -  0.  But  in  this  case  ALUx  *  A  L XB  *  CB  does  not  vanish, 
too.  Therefore  dim(im(ALU) ' )  > dim(U"1( imX)  n  (TU)"1(imA))  - 

.  i 

dim(im(U  GAGU)).  This  implies  the  required  condition  about  the 
null-space.  Now  let  T  be  an  orthogonal  transformation  such  that 
U'G'AGU  ■  T  dlag(X^, . . . ,Xq)t'  and  similarly  Tj^  be  an  orthogonal 
transformation  such  that  Tj^  diag(X*, . . .  ,X*)  T^  *  u'l'ALU.  By 
spherical  symmetry  t'  e  and  T^e  have  the  same  distribution  as 
e .  Therefore 

P(e  UG'  AGU<  c2) -P(e'diag(X1 . Hb)e<c2)  (5.5) 

and 

PU’u'l'ALU  e  <  c2)  -  P(e '  diag(xj, . . . ,X*)e  < c2). 


(5.6) 


Since  X^X^,  it  follows  that  e'  diag  (A^, .  ,Am)e  _< 

e’  diag  ( Xj , . . . ,  Xm)e  and  from  this  evidently  (5.3)  is  obtained. 
Q.E.D. 

5.2  Remark.  A  weak  version  of  this  result  was  recently  pre¬ 
sented  by  Ali  and  Ponnapalli,  (1982). 
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